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@ Method and system for digital image signatures. 

@ A method and system for embedding signatures within visual images in both digital represerrtalion and print 
or film. A signature is inseparably embedded within the visible Image, the signature persisting through image ; 
transforms that include resizing as well as conversion to print or film and back to digital form. Signature points 
aie selected from among the (xxels of an original image. The pixel values of the signature points and 
surmunding pixels are adjusted by an amount detectable by a digital scanner. The adjusted signature points 
form a digital signature wtiich is stored for future identification of subject images derived from the image. In one 
embodiment, a signature is embedded within an image by locating relative extrema in the continuous space of 
pixel values and selecting the signature points from among the extrema. Preferably, the signature is redundantly 
embedded in the Image such that any of the redundant representations can be used to identify the signature. 
Wentification of a subject image includes ensuring that the subject image is normalized with respect to the 
original image or the signed image. Preferably, the nonnalized subject image Is compared with the stored digital 
signature. 
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This invention relates to b method of and system for encoding a signature into a digital image and 
auditing a digital subject Image to detenmine if it was derived from the encoded image. 

Bact<ground of the invention 

Various Images in traditional print or photographic media are commonly distributed to many users. 
Examples include the distribution of prints of paintings to the genera! public and photographs and film clips 

10 to and among the media. Owners may wsh to audit usage of their Images in print and electronic media, 
and so require a method to analyze print, film and digital images to determine if they were obt^ned directJy 
from the owners or derived from their images. For example, the owner of an image may desire to limit 
access or use of the image. To monitor and enforce such a iim'rtation. it would be beneficial to have a 
method of verifying thai a subject image is copied or derived from the owner's image. The method of proof 

IS should be accurate and incapable of being circumvented. Further, the method should be able to detect 
unauthorized copies that have been resized, rotated, cropped, or othenwse altered slightly. 

In the computer field, digital signatures have been applied to non-image digital data in order to identify 
the origin of the data. For various reasons these prior art digital signatures have not been applied to digital 
image data One reason is that these prior art digital ^nahjres are lost If the data to which they are applied 

20 are modified. Digital Images are often mpdffied each time Ihey are printed, scanned, copied, or photo- 
graphed due to unintentional "noise" created by the mechanical reproduction equipment used. Further, it is 
often desired to iBsize. rotate, crop or otherwise Intentionally modify the image. Accordingly, the existing 
digital signatures are unacceptat>le for use with digital images. 

25 Summary of the Invention 

The invention includes a method and system for? embedding image signatures within visual im^es, 
applicable in the prefenred embodiments described herein to digital representations as well as other media 
such as print or film. The signatures identify the source or ownership of images and distir>guish between 

30 different copies of a singte image. In preferred embodiments, these signatures persist through image 
transfbnns such as re^ng and conversion to or^frcfti print or film and so pnsvide a method to track 
subsequent use of digital images including derivative irriges In print or other form. 

In a preferred embodiment described her^n, a plurality of signature points are selected that are 
positioned within an original image having pixels with pJ)cel values. The pixel values of the signature points 

35 are adjusted by an amount detectable by a digital scanner. The adjusted ^gnature points form a digHal 
signature that Is stored for future identification of subject Images derived from the image. 

TTie preferred embodiment of the invention described herein embeds a signature wittiin ttie original 
Image by tocating candidate points such as relative extrema in the pixel values. Signature points are 
selected from among tiie candidate points and a data bit Is encoded at each ^grvature point by adjusting 

40 the pbce! value at and surrounding each point Preferably, the signahjre is redundantiy embedded in tiie 
image such that any of the redundant representations can be used to identify the signature. The signature is 
stored for later use in identifying a subject image. 

According to a pretened embodiment, the identification of a subject image includes ensuring that the 
subject image is nornialized, Le„ of the same size, mtation. and brightness level as the original image. If not 

4S already nontialized. the subject image is normalized by aligning and adjusting the luminance values of 
subsets of the pixels In the subject image to match corresponding subsets in the original imago. The 
nonnalized subject Image is ttien subtracted from the original image and.tfie result is compared with the 
stored digital signature. In an alternate emt)odiment, the nonnalized subject image is compared directly witii 
the signed image. 
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Brief Description of tie Drawings 



Rgure 1 is a diagram of a computer system used in a preferred embodiment of the present invention. 
Rgure 2 is a sample digital image upon vi^ich a preferred embodiment of the present invention is 
55 employed. 

Figure 3 is a representation of a digital image In the form of an array of pixels with pixel values. 
Figure 4 Is graphical representation of pbcel values showing relative minima and maxima pixel values. 
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Figure 5 is a digital subject image that is compared 1o the image of Figure 2 according to a preferred 
emljodlment of the present invention. 

Detailed Description of the lovention 

The present invention includes 9 method and system for embedding a signature into an original image 
to create a signed image. A preferred embodiment includes selecting a large number of candidate points in 
the original image and setecting a number of signature points from among the candidate points. Tlie 
signature points are altered slightly to fonn the signature. The signature points are stored for later use in 
auditing a subject image to detenmlne whether the subject image is derived from the signed imago. 

The signatures are encoded in the visible domain of the image and so become part of the image and 
cannot be detected or removed without prior knowledge of the signature. A key point is that white the 
changes manifested by the signature are too slight to be visible to the human eye. they are easily and 
consistently recognizable by a common digital image scanner, after which the signabjre is extracted, 
interpreted and verified by a software algorrthm. 

In contrast to prior art signature methods used on non-image data, the signatures persist through 
significant image transformations that preserve the visible image but may completely change the digital 
data. The specific transforms allowed include resizing the image larger or smaller, rotating the image, 
uniformly adjusting cotor, brightness and/or contrast, and limited cropping. Significantly, the signatures 
persist through the process of printing the image to paper or film and rescanning tt Into digital form. 

Shown in Rgure 1 is a computer system 10 that is used to cany out an embodiment of the present 
invention. The computer system 10 Includes a computer 12 having tiie usual complement of merrory and 
logic circuits, a display monitor 14. a keyboard 16. and a mouse 18 or other pointing device. The computer 
system also includes a digital scanner 20 that is used to create a digital image representative of an original 
image such as a photograph or painting. Typically, delicate images, such as paintings, are converted to 
print or film before being scanned into digital fonn. In one embodiment a printer 22 is connected to the 
computer 12 to print digital images output from the processor. In addition, digital Images can be output in a 
data format to a storage medium 23 such as a floppy disk for displaying later at a renvDte site. Any digital 
display device may be used, such a common computer printer. X-Y plotter, or a display screen. : > 

An example of the output of the scanner 20 to tiie computer 1 2 is a digital image 24 shown in Rgure 2. 
More accurately, the scanner outputs data representative of the digital image and tiie computer causes the 
digital image 24 to be dispbyed on the display monitor 14. fis used herein "digital image" refersito the 
digital data representative of the digital image, tt» digital image displayed on the monitor or other display 
screen, and the digital image printed t>y the printer 22 or a remote printer. )f 

The digital image 24 is depicted using numerous [wxels 24 having various pixel values. In the gray-scale 
image 24 tiie pixel values are luminance values representing a brightness level varying from black to white. 
In a color image ttie pixels have color values and luminance values, both of vrtiich being pixel values. The 
color values can include tiie values of any components In a representation of the color by a vector. Figure 3 
shows digital Image 24A in the fonn of an an^ay of pixels 26. Each pixel is associated with one or more pixel 
values, which in the example shown in Rgure 3 are luminance values from 0 to 15. 

The digital image 24 shown In Rgure 2 Includes ttrausands of pbcels. The digital image 24A represented 
in Rgure 3 includes 225 pixels. The invention preferably is used for images having pixels numbering in tiie 
millions. Therefore, the description herein is necessarily a simplistic discussion of the utility of the invention. 

According to a prefen-ed embodiment of the invention numerous candidate points are located witiiln tiie 
original Image. Signature points are selected from among the candidate points and are altered to form a 
signature. The signature is a pattern of any number of signature points. In a preferred embodiment, tiie 
signature is a binary number between 16 and 32 bits in length. The signature points may be anywhere 
within an image, but are preferably chosen to be as inconspicuous as possible. Preferably, tiie number of 
signature points is much greater ttian the number of bits In a signature. This allows the signature to fc>e 
redundantiy encoded in the image. Using a 16 to 32 bit signature. 50-200 signature points are preferable to 
obtain multiple signatures for the image. 

A prefenBd embodiment of the invention locates candidate points by finding relative maxima and 
mituma. collectively refen-ed to as extrema. in tiie image. The extrema represent local extremes of 
luminance or color. Rgure 4 shows what is meant by relative extrema. Rgure 4 is a graphical representation 
of the pixel values of a small portion of a digital image. The vertical axis of the graph shows pbcel values 
while tiie horizontal axis shows pixel positions along a single line of tiie digital image. Small undulations in 
pixel values, indicated at 32. represent portions of the digital image where only small changes in luminance 
or color occur between pixels. A relative maximum 34 represents a pixel tiiat has the highest pixel value for 
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B given area of the image. Similarly, a relative minimum 36 represents a pixel that has the lowest pbtel 
value for a given area of the image. 

Relative extrema aro preferred signature pdnts for two major reasons. Rrst, they are easily located by 
simple, well known processing. Second, they allow signature pants to be encoded very inconspicuously. 

One of the simplest methods to determine relative esxtrema is to use a "Difference of Averages" 
technique. This technique employs predetermined rieighborhoods around each pixel 26; a small neighbor- 
hood 28 and a large neighborhood 30, as shown In Figures 2 and 3. In the present example the 
neighborhoods are square for simplicity, but a preferred embodiment employs circular neighborhoods. The 
technique determines the difference between the average pixel value in the small neighborhood and the 
average pixel value of the large neighborhood. If the difference is large compared to the difference for 
sunrounding pbcels then the first pixel value is a relative maxima or minima. 

Using the image of Rgure 3 as an example, the Difference of Averages for the pixel 2eA is determines 
as follows. The pixel values within the 3x3 pixel small neighborhood 28A add up to 69: dividing by 9 pbcels 
gives an average of 7.67. The pixel values within the 5x5 pixel large neighborhood 30A add up to 219; 
dividing by 25 pixels gives an average of 8.76 and a Difference of Averages of -1.09. Similarly, the average 
in small neighborhood 28G is 10.0; the average In large neighborhood 30G is 9.8; the Difference of 
Averages for pixel 26G is therefore 0.2. Similar computations on pixels 26B-26F produce the following table: 





26A 


26B 


260 


26D 


26E 


26F 


26G 


Small Neighborhood 
Large Neighbortiood 
Difference of Averages 


7.67 ; 

8.76 
-1.09 


10,56 
10.56 
0.0 


12.89 
12.0 
0.89 


14.11 
12.52 
1.59 


13.11 
12.52 
0.59 


11^ 
11.36 
0.2 


10.0 
9.8 
0.2 
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Based on pixels 26A-26G- there may be a relative maximum at pixel 26D, whose Difference of Averages of 
159 Is greater than the Difference of^A>^?rages for the other examined pixels in the row. To determine 
whether pixel 26D is a relative naaodmum rather than merely a small undulation, its Difference of Averages 
must be compared witii the EHfference of Averages for the pixels sunt)unding It in a larger area. 

Preferably, extrema vfltiiin 10% of the image size of any side are not used as signature points. This 
protects against loss of signature points caiused by the practice of cropping the border area of an inrage. It 
is also preferable that reiative extremaltrtat? are randomly and widely spaced are used rather than those that 
appear in regular patterns. 

, Using the Difference of Averages technique or other known techniques, a large numtjer of extrema are 
obtained, the number depending on the (^1 density and contrast of the image. Of the total number of 
extreme found, a preferred embodiment chooses 50 to 200 signature points. This may be done manually by 
a user choosing with the keyboard 16. mouse 18, or other pointing device each signature point from amopg 
the extrema displayed on tiie display monitor 14. The extrema may be displayed as a digital image witii 
each point chosen by using tiie mouse or other pointing device to point to a pixel or they may be displayed 
as a list of coordinates which are chosen by keyboard, mouse, or other pointing devtee. Alternatively, the 
computer 12 can t>e programmed to choose signature points randomly or according to a preprogrammed 
pattem. 

One bit of binary data Is encoded in each signature point in the image by adjusting the pixel values at 
and surrounding the point The image is modified by making a small, preferably 2%-10% poative or 
negative adjustment in the pixel value at the exact signature point, to represent a binary zero or one. The 
[Acels surrounding each signature point, in approximately a 5 x 5 to 10 x ID grid, are preferably adjusted 
proportionally to ensure a continuous transition to the new value at tine signature point A number of bits are 
encoded In the signature points to form a pattem which Is the signature for tiie image. 
• In a pretend emtjodiment, tiie signature is a pattem of all of tiie signature points. When auditing a 
subject image, if a statistically significant number of potential signature points in the subject image match 
corresponding signature points in the signed image, then the subject image is deemed to be derived from 
the signed image. A statistically significant number is somewhat less than 100%. but enough to be 
reasonably confident that the subject Image was derived from the signed Image. 

In an ailemate embodiment, the signature is encoded using a redundant pattem that distributes it 
among the signature points in a manner tiiat can be reliably retrieved using only a subset of tiie points. One 
embodiment simply encodes a predetermined number of exact duplicates of the signature. Otiier redundant 
representation methods, such as an error-correcting code, may also be used. 

In order to allow future auditing of images to determine whether they match the signed image, the 
-a*gnaturens-stored"in-3-databaseinnrt?hichit iVassociated-^^ 
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stored by associating the bit value of each signature point together with x-y coordinates of the signature 
point The signature may be stored separately or as part of the signed image. The signed image is then 
distributed in digital form. 

As discussed above, the signed image may be transformed and manipulated to form a derived Image. 
5 The derived image is derived from the signed Image by various transfonmations, such as resizing, rotating, 
adjusting color, brightness and/or contrast cropping and converting to print or film. The derivation may take 
place in multiple stops or processes or may simply be the copying of the signed image directly. 

It is assumed that derivations of these images that an owner wishes to track Include only applications 
which sutjstantially present the resolution and general quality of the image. While a size reduction by 90%. 
10 a significant color alteration or distinct-pixel-value reduction may destroy the signature, they also reduce the 
images significance and value such that no auditing is desired. 

In order to audit a subject image according to a preferred embodiment, a user identifies the original 
image of which tiie subject image is suspected of being a duplicate. For a print or film image, the subject 
image Is scanned to create a digital image file. For a digital image, no scannir>g is necessary. The subject 
15 digital image is normalized using techniques as described below to the same size, and same overall 
t>rightness. contrast and color profile as the unmodified original image. The subject image is analyzed by 
the method described below to extract the signature, if present and compare it to any signatures stored for 
that image. 

The nonmalization process involves a sequence of steps to undo transformations previously nryade to the 
20 subject image, to return it as close as possible to the resolution and appearance of the original imago. It is 
assumed that tiie subject image has been manipulated and transformed as described above. To align the 
subject image witii the original image, a preferred embodiment chooses three or more points from the 
subject image which conBspond to points in the original image. The three or more points of the subject 
Image are aligned witii ttie corresponding points in ttie original image. The points of the subject image not 
25 selected are rotated and resized as necessary to accommodate the alignment of the points selected. 

For example, Rgure 5 shows a digital subject image 38 that is smaller than ti)e original image 24 shown 
in Figure Z To reslze' the subject image, a user points to three points such as mouth 40B, ear 42B and 
eye 44B of the subject image using the mouse 18 or ottier pointer. Since ft is usually difficult to accurately 
point to a single pixel, the computer seJeds the nearest extreme to the pixel ppinte*! to by the user. The 
30 user points to the moutii 40Ar ear 42A, and eye 44A of the original image. The ccjnputer 12 resizes and 
rotates the subject image as necessary to ensure that points 40B, 42B, and 44B arerpbsitioned with respect 
to each other in tine same way that points 40A, 42A, and 44A are poationed with riiispect to each other in 
tte original image. The remaining pixels are repositioned In proportion to the repositioning of points 408, 
428 and 448. By aligning three points the entire subject image is aligned witii the^original im^e without 
36 having to align each pbcet independentiy. 

After tiie subject image is aligned, the next step is to normalize Ihe brightness, contrast and/or color of 
the subject Image. Normalizing involves adjusting pbcel vaiues Of the subject image to match the vaiu&- 
distribution profile of the original Image. This is accomplished by a technique analogous to that used to 
aOgn the subject image. A subset of the pixels in the subject image are adjusted to equal corresponding 
40 pixels in the original image. The pbcels not In the subset are adjusted in proportion to the adjustments made 
to the pixels in the subset The pixels of the subject image corresponding to the signature points should not 
be among the pixels in the subset Ottienvise any signature points In the subject image will be hidden from 
detection when they are adjusted to equal conresponding pixels in the original image. 

in a preferred embodiment, the subset includes the brightest and darkest pixels of the subject image. 
45 These pixels are adjusted to have luminance values equal to the luminance values of conresponding pixels 
in the original image. To ensure that any signature points can be detected, no signature points should be 
selected during the signature embedding process descrit>ed above that are among the brightest and 
daricest pixels of the original image. For example, one could use pixels among the brightest and daricest 3% 
for tile adjusting subset, after selecting signature points among less than the brightest and darf^est 5% to 
50 ensure that tf>ere is no overlap. 

When the subject image is fully normalized, it is preferably compared to the original image. One way to 
compare images is to subtract one image from the other. The result of the subtraction is a digital image that 
includes any signature points that were present in the subject image. These signature points, if any, are 
compared to ttie stored signature points for ttie signed image. If the signature points do not match, then ttie 
66 subject image is not an image derived from the signed image, unless tiie subject image was changed 
substantially from the signed image- 
In an alternative embodiment, the nomnalized subject image is compared direcUy with the signed image 
instead of subtracting the subject image from the original image. This comparison involves s ubtracting the 
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subject image from the signed image. If there is litUe or no image resuitir^g from the subtraction then the 
subject image equals to the signed image, and therefore has been derived from the signed image. 

In another alternate embodiment Instead of normalizing the entire subject image, only a section of the 
subject Image surrounding each potential signature point Is nomialized to be of the same general resoluSon 

6 and appearance as a corresponding section of the original Image. TTiis is accomplished by selecting each 
potential signature point of the subject image and selecting sections sun^unding each potentiai signature 
poim. The normalization of each selected section proceeds according to me^ods similar to those disclosed 
above for normafizing the entire subject Image. 

Normalizing each selected section individually allows each potential signature point of the subject 

70 image to be compared directly with a conBsponding signature point of the signed image. Preferably, an 
average is computed for each potepSal signature point by averaging the pixel value of the potential 
signature point with the pixel values of a plurality of pixels surrounding the potential signature point. The 
average computed for each signature is compared directly with a con^ponding signature point of the 
signed image. 

75 While the methods of nonnalizing and extracting a signature from a subject image as descrtbed above 
are directed to luminance values, similar methods may be used for color values. Instead of or in addition to 
nonnaliang by altering luminance values, the color values of the subject image can also be adjusted to 
equal con^sponding color values In an original color image. However, it is not necessary to adjust color 
values In order to encode a signature in or extract a signature from a color Image. Color images use pixels 

20 having pixel values that Include luminance values and color values. A digital signature can be encoded In 
any pbcel values regardless of whether the pixel values are luminance values, color values, or any other 
type of pixel values. Luminance values are preferred because alterations may be made more easily to 
luminance values without the alterations toeing visible to the human eye. 

From the foregoing it v/ill be appreciated that, although specific embodiments. of the Invention have 

25 been described herein for purposes of illustration, various modifications may be made without deviating 
from the spirit and scope of the invention. Accondingly, the invention is not fimited except as fciy the 
appended claims. t '^^^ " 
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Claims 



A motiiod of imageiagjiature processing of an original image having pixels witl^ luminance values, 
compri^ng: - ^ ' ^ 

locating a plurality candidate points from among the pixels of the Original image; 
selecting a first plur^ity of signature points from among the candidate points^ 
35 adjusting the pixel walues of the signature points to form a »'gned image. Ae adjusted signature 

point pbcel values forming a signature for the signed image; and 
storing the ^g nature for future identification. 

2. The metiiod according to claim 1 wherein the candidate points are located by locating relative ^ema 
40 in the original image and wherein the selecting step includes selecting the signature points from among 
the extrema. 

3- TTie mettK)d according to daim 2 wherein the extreme are relative minima or maxima of luminance 
values of the pixels of the original image. 

45 

4. The me^ according to daim 1, further comprising adjusting a plurality of pixel values surrounding 
tiie signature points to provide smootfi tranations to tiie adjusted pixel values at tiie signature points. 

5. The method according to claim 1 , furttier comprising: 

$0 selecting a second plurality of signature points from among the candidate points; and 

adjusting fhe pixel values of the second plurality of signature points to fomn a redundant signature 
for the signed image. 

6. A method of image signature processing of an original image having pixels vwth pixel values, 
55 comprising: 

selecting a first plurality of signature points from among the pixels of the original image; 
adjusting the pixel values of the signature points, the adjusted signature point pixel values fonning 
a signature for the image; and 
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storing the signature for future identification. 

7. The method according to claim 6, further comprising locating relative extrema in the original image and 
wherein the selecting step includes selecting the signature points from among the extrema. 

a "me method according to claim 7 wherein the extrema are relative minima or maxima of luminance 
values of the pixels of the original image. 

9. The method according to claim 6 further comprising: 

selecting a second plurality of signature points from among the candidate points; and 
adjusting the pixel values of the second plurality of signature points to form a redundant signature 
for the signed image. 

10. The method according to claim 6 wherein the digital image has a twrder sun-ounding the image and the 
pixel values adjusted are selected so as not to be within a predetermined distance from the border. 

11. The method according to claim 6. further comprising adjusting a plurality of pixel values sumjunding 
the signature points to provide smooth transitions to the adjusted pixel values at the signature points. 

12. The method according to claim 6 wherein the pixel values adjusted are luminance values. 

13. The method according to claim 6 wherein the pixel values adjusted are color values. 

14. The method according to claim 6» further comprising analyzing whether a digital subject Image 
constitutes or is derived from a signed image having pixel values that were adjusted to form a signature 
according to claim 6. 

15. Tha method according to claim 14 wherein the analyzing step includes normalizing the subject image. 

16. The method according to claim 15 wherein the nonnallzing step includes aligning tiie subject image 
v/ith the signed image or the original image. . y ■ 

17. The method according to daim 16 wherein the aligning step includes selecting three or more pixels In 
the subject image and aligning the three or more peels with con-esponding pixels in^the original or the 
signed image. 

ia The method according to claim 15 wherein the pixel values of the subject image and the original imago 
include luminance values arxJ the normalizing step Includes adjusting the luminance values of a subset 
of the pixels in the subject image to equal the luminance values of a corresponding subset of pixels in 
the original image. 

19. The method according to daim 14 wherein the analyzing step includes subtracting the subject image 
from the original image to obtain a resulting image and comparing the resulting image with the stored 
signature. 

20. The method according to daim 14 wherein the analyzing step includes comparing the subject image 
v^th the signed image. 

21. The method according to daim 14 wherein the analyzing step includes selecting a potential signature 
point in the subject image corresponding to a signature point of the signed image and comparing the 
pixel value of the selected point to the pixel value of the corresponding signature point of the signed 
image. 

22. The method according to claim 14 wherein the analyzing step includes selecting a potential signature 
point in the subject image con-esponding to a signature point of the signed image, computing an 
average of pixel values of the potential signature point and a plurality of pixels sunrounding the potential 
signature point, and comparing the average to the pixel value of the corresponding signature point of 
the signed image. 
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23. A method of determining whether a subject image having pixels with pixel values constitutes or is 
derived from a signed image having pixels with pixel values that have been adjusted to collectively 
form a signature, comprising: 

ensuring that the subject image is normalized with respect to an original image or the signal image; 
comparing the signature of the signed image with potential signature points of the subject image 
corresponding to the pixels of the signature. 

24. Th9 method according to claim 23 wherein the ensuring step includes normalizing the subject image 
with respect to the original image or the signed image. 

25. The method according to claim 24 wherein the normalizing step includes aligning the subject image 
with the signal image or the original image. 

26. The method according to claim 25 wherein the aligning step includes selecting tiiree or more pbcels in 
IS the subject imago and aligning the three or more pixels with a like number of pixels in the onginal or 

signed image. 

27- The method according to daim 24 wherein the pixel values of the sufc^ect image and the original image 
include luminance values and the nonmaiizing step includes adjusting the luminance values of a subset 
20 of the pixels in the subject image to equal the luminance value of a qoiresponding subset of pixels In 
the original image. 

28. The method according to claim 23 wherein the comparing step inpludes subtracting the subject image 
from the original image to obtain a resulting image and comparing the resulting image witii the stored 
26 digital signature. 

29l The method according to clainv^ wherein the comparing step Includes comparing the subject image 
with the signed image. 

30 30. The method according to claim 23 wherein tiva comparing step includes selecting the potential 
signature points con^sponding % pixels of the signature, computing an average of the pixel values of 
each potential signature point and a phjralrty of pixels sunrounding each signature point, and comparing 
each average to the pixel valued the corresponding signature point of the signed image. 

35 31. A system for image signahire processing of an original image having pixels with pixel values, 
comprising: 

a cfisplay device for displaying digital images to a user; 

selection means for selecting a plurality of signature points from among the pbcels of the original 
image; , 
40 a computing device in communication with the display device and the selechon means^ tne 

computing device adjusting the pbcel values of the signature points to form a signed image, the 
adjusted signature point pixel values forming a signature associated with the signed image: and 

memory in communication with the computing device, the memory receiving the signature from the 
computing device and storing the signature for futore identification. 

• ^ 32. The system according to claim 31 wherein tiie computing device includes location means for locating 
candidate points from among tiie pixels in the original image and the selecting means selects signature 
points from among the candidate points. 

50 3a The system according to cjaim 32 wherein ttie selection means includes a pointer operatively 
connected to the display device and the computing device such that a user can select signatore points 
from among the candidate points displayed on the display device and the computing device alters the 
signature points selected to form a signature associated with the signed image. 

55 34. The system according to claim 32 wherein the location means includes means for locating pixel value 
extrema in the original image, the exirema being the candidate points. 
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35. The system according to claim 31 wherein the computir>g device includes means for identifying a 
subject image derived from the signed image. 

36. The system according to claim 35, further comprising normalizing means for nonnnaliang the subject 
£ image with the original image.or the signed image. 

37. The system according to claim 36 wherein the normalizing means includes a pointer operatively 
connected to the display device and the computing device such that a user can select alignment points 
from among the pixels of the subject image displayed on the display device and the computing device 

TO receives the alignment points selected and aligns the subject image with tiie original image or the 
signed image in response thereto. 

38. The system according to claim 36 wherein the computing device includes comparing means for 
comparing the normalized subject image with the original image or the signed image. 

76 

39. The system according to claim 36 wherein the computing device includes: 

subject selectiDn means for selecting a potential signature point on the subject Image correspond- 
ing to a signature point of the signed image; 

averaging means for computing an average of the pixel values of the potential signature pdnt and a 
20 plurality of pixels surrounding the potenttal signature point; and 

comparing means for comparing the average to a pixei value of the conresponding signature point 
of the signed image. 
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Figure 3 



11 



EP 0 581 317 A2 



-23 

30-- -25 




i . . . i 

Figure 2 




42B 



Figure 5 



12 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 



P^LACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: ■ • 



IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




mis PAGE BLANK (USPTO) 



